A search quality evaluation based on objective-subjective method

Commercial search engines, especially meta-search engines was designed to retrieve the information by submitting users’ queries to multiple conventional search engines and integrating their partial searching results generated by each search engine. How to find the best search engine for user queries is know as the selection problem of search engines. Recently, the selection problem has become a research hotspot in meta-search engines. Therefore, it is the key technology to evaluate the quality of the search result of every search engine. In this paper, the objectivesubjective measure method was proposed. At first, we focus on objective evaluation of search quality. From global viewpoint, we calculated the average correlation coefficient of one search result list with other search result lists, the correlation coefficient described the relation among the original lists of search results, and it is objective measure of the search result of search engine;Second, we focus on the subjective evaluation of search quality. We measure the user satisfaction to each search result of search engine by comparing the implicit ranking provided by the user feedback with the original ranking given by the search engine. At last, the objective-subjective measure method is the weighted sum of the average correlation coefficient and the user satisfaction. What more, we discussed the algorithm of our proposed method.